Inference Methods for Autonomous Stochastic Linear Hybrid Systems
نویسندگان
چکیده
We present a parameter inference algorithm for autonomous stochastic linear hybrid systems, which computes a maximum-likelihood model, given only a set of continuous output data of the system. We overcome the potentially intractable problem of identifying the sequence of discrete modes by using dynamic programming; we then compute the maximum-likelihood continuous models using an Expectation Maximization technique. This allows us to find a maximum-likelihood model in time that is polynomial in the number of discrete modes as well as in the length of the data series. We prove local convergence of the algorithm. We also propose a novel initialization technique to derive good initial conditions for the model parameters. Finally, we demonstrate our algorithm on some examples two simple one-dimensional examples with simulated data, and an application to real flight test data from a dual-vehicle demonstration of the Stanford DragonFly Unmanned Aerial Vehicles.
منابع مشابه
A Combined Stochastic and Greedy Hybrid Estimation Capability for Concurrent Hybrid Models A Combined Stochastic and Greedy Hybrid Estimation Capability for Concurrent Hybrid Models with Autonomous Mode Transitions
Robotic and embedded systems have become increasingly pervasive in applications ranging from space probes and life support systems to robot assistants. In order to act robustly in the physical world, robotic systems must be able to detect changes in operational mode, such as faults, whose symptoms manifest themselves only in the continuous state. In such systems, the state is observed indirectl...
متن کاملReachability Analysis and its Application to the Safety Assessment of Autonomous Cars
This thesis is about the safety verification of dynamical systems using reachability analysis. Novel solutions have been developed for three major problem classes: Classical reachability analysis, stochastic reachability analysis, and their application to the safety assessment of autonomous cars. Classical reachability analysis aims to compute the exact or over-approximative set of states that ...
متن کاملProbabilistic Inference using Linear Gaussian Importance Sampling for Hybrid Bayesian Networks
Probabilistic inference for Bayesian networks is in general NP-hard using either exact algorithms or approximate methods. However, for very complex networks, only the approximate methods such as stochastic sampling could be used to provide a solution given any time constraint. There are several simulation methods currently available. They include logic sampling the first proposed stochastic met...
متن کاملEstimating parameters in stochastic systems: A variational Bayesian
8 This work is concerned with approximate inference in dynamical systems, from a variational Bayesian perspective. When modelling real world dynamical systems, stochastic differential equations appear as a natural choice, mainly because of their ability to model the noise of the system by adding a variation of some stochastic process to the deterministic dynamics. Hence, inference in such proce...
متن کاملStochastic Reachability: From Markov Chains to Stochastic Hybrid Systems
Stochastic hybrid systems represent established classes of realistic models of hybrid dynamics subject to random perturbations, autonomous uncontrollable transitions, nondeterminism or uncertainty. Stochastic reachability analysis is a key factor in the verification and deployment of stochastic hybrid systems. In this paper, we tackle the stochastic reachability problem from a purely probabilis...
متن کامل